A RIEMANN-HILBERT PROBLEM FOR SKEW-ORTHOGONAL POLYNOMIALS 



VIRGIL U. PIERCE 

Abstract. We find a local (d + 1) X (d + 1) Ricmann-Hilbert problem characterizing the skew-orthogonal 
polynomials associated to the partition function of the Gaussian Orthogonal Ensemble of random matrices 
with a potential function of degree d. Our Riemann-Hilbert problem is similar to a local d X d Riemann- 
Hilbert problem found by Kuijlaars and McLaughlin characterizing the bi-orthogonal polynomials. This gives 
more motivation for finding methods to compute asymptotics of high order Riemann-Hilbert problems, and 
brings us closer to finding asymptotics of the skew-orthogonal polynomials. 
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1. Introduction 

The partition function of random matrices for the Gaussian Unitary Ensemble (GUE) is associated with 
a family of orthogonal polynomials Pj (x) given by the conditions 

(1.1) I P j (x)P k (x)e- Nv ^dx = h j 6 jk , 



where V(x) is an even degree polynomial with positive leading coefficient, and Pj(x) = x 3 4- 0{x 3 : ) for 

A 1/2 

x — ► oo (7J[T51[25] . Define the orthonormal polynomials Pj(x) = Pj(x)/hj . The asymptotic expansion of 
the classical families of orthogonal polynomials were computed by [30] . The orthonormal polynomials satisfy 
a three term recursion relation that, under changes in V, satisfies the Toda lattice hierarchy. They may be 
represented as Hankel determinants [27] . 

To compute the orthogonal polynomials numerically it is helpful to use the following result: Define the 
moments 

Let M be the symmetric matrix = m i+ j. Then factor M = QDR using the Qi?-algorithm. The columns 
of give the coefficients of the orthogonal polynomials. 

One may show that the zeros of the orthogonal polynomials are real, interlace, and their distribution 
converges to a measure n(V) which is given as the solution to a minimization problem [9]. 

The asymptotic expansions of Pn and Pn-i are computed by realizing them as the unique solutions of a 
2x2 Riemann-Hilbert problem (see (9[ [T2l [T3l [22] ). These expansions were assembled and used to prove 
the existence of an asymptotic expansion of ™ log (Zn(V)) for a cone of V, in [T5] , 

Similar studies have been started regarding multi-matrix models and multi-orthogonal polynomials [S]. 
The simplest case is that of bi-orthogonal polynomials given by two families of polynomials {Pk{x)} and 
{Qk[x)} satisfying 

Pj(x)Q k (y) exp {-N(V{x) + W(y)) - 2Nrxy] dxdy = hjS jk , 

where r is a non-zero coupling constant, V(x) and W(y) are polynomials of even degree with positive 
leading coefficient, Pj(x) = x j + 0{x^ 1 ) for x — > oo, and Q k {y) = y k + 0(y k ^ 1 ) for y — > oo [14 . The 
bi-orthogonal polynomials satisfy a recursion relation that, under changes in V, satisfies the Full-Kostant 
Toda lattice hierarchy. One may compute them as determinants [14) . They may be characterized in terms 
of Riemann-Hilbert problems (see jfj[ [14 ] I2D ] [2T [ [53] ) . 
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To compute the bi-orthogonal polynomials numerically it is helpful to use the following result: Let M be 
the matrix of moments 



Mij = [[ x l y j exp [-N(V(x) + W{y)) - 2Ntx V ] dxdy. 
J J«? 

Then factor M = LDU using Gaussian elimination. The columns of U~ 1 give the coefficients of Qk{y) while 
the rows of L _1 give the coefficients of Pj(x). 

One may show that the zeros of the bi-orthogonal polynomials are real [14] . One finds numerically that 
they interlace and the suspicion is that their distributions converge to a pair of measures. 

The bi-orthogonal polynomials are solutions of a non-local 2x2 Riemann-Hilbert problem (see [61 114)). 
Recently a local dx d Riemann-Hilbert problem that determines the bi-orthogonal polynomials was found in 
the case when deg(W) = d by [21]. The advantage of this local problem is that there is reason to believe it is 
more amenable to asymptotic analysis, see [23]. Another high order Riemann-Hilbert problem characterizing 
the bi-orthogonal polynomials has been found by [5]. 

Define the skew-inner products 

(1.2) (/, g)i = ff f(x)g(y)e(x ~ y)e~ NV ^- NV ^dxdy, 

where 

, s f-1 : x< 
w \ 1 : x > 



(1.3) 



(f,9)4 



[f(x)g'(x) - f'(x)g(x)} e~ NV ^dx. 



The partition functions of random matrices for the Gaussian Orthogonal Ensemble (GOE) (/3 = 1) or 
Gaussian Symplectic Ensemble (GSE) ((3 — 4) are associated with skew-orthogonal polynomials {pj(x)} 
given by the conditions 



(1.4) 
(1.5) 
(1.6) 
(1.7) 



(P2k(x),p 2] (y))t3 = 

(P2k(x),P2j + l(y))p = hjSkj 
(P2k+l(x),P2j(y))p = "hjSkj 
(P2k+l{x),P2j + l{y))f3 = o, 



where P2j(x) — x 2 i + 0{x 2 i x ), and P2j+i(a 



Oix 2 ^ 1 ) for x -> oo (see [2] [TD1 HU El US H2 [SS 



126J[28J[29J[3T1[351[33]) . There is an ambiguity in conditions (|1.4[) - (|1.7p in the sense that p2j+i = P2j+i+a<P2j 
may properly be called a skew-orthogonal polynomial of degree 2j + 1 for any a. We define the 2j + 1 skew- 
orthogonal polynomial to be the one with a zero coefficient of x 2 i . Define the skew-orthonormal polynomials 

to be p 2j (x) =p2 j (x)/(p2 J1 P2j+i) 1 J 2 , and p 2 j+i(x) = p 2 j+i(x)/ (p 2 j,P2j+i) 1 / 2 ■ 

The skew-orthonormal polynomials satisfy a recursion relation that, under changes in V, satisfies the Pfaff 
lattice hierarchy. For example if V = Vo(x) + tjx 3 then it can be shown that the recursion relation is of the 
form 



xp(x) — Lp{x), 



where p(x) = (p (x),pi(x),p 2 (x), ...) T and 



(0 


1 
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di 


a i 
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d 2 



Let 



/O 1 



(1.8) 



J = 



-1 



1 

0-10 



Then L satisfies the differential equation 



dL 
dt ; 



= -[n k (U),L] 



where 



1 



7r fc (M) = M- - JM±J+ -(M - JMq J), 



and M± is projection onto the upper ( resp. lower) 2x2 block triangular parts of M and Mo is projection 
onto the diagonal 2x2 blocks of M [2 H @] . 

Define the Pfaffian of a skew-symmetric matrix M by 

det(M) = [pf(M)] 2 . 

Define the skew-symmetric matrix of moments 

M ij = (x\yi) f3 . 

Then one finds Pfaffian formulas for the skew-orthogonal polynomials (see [HOIl]): 



P2j{x) = pf 



/ o 

-Moi 



-Mi 



02., 



M i 


-M 12j 
—x 



M 02 
Mia 



-M 



22, 
2 



and 



P2j+i(a;) = pf 





-Moi 

-1 



Moi 




V-M 02 j+i -Mi2j+i 

To compute the skew-orthogonal polynomials numerically it is helpful to use the following representation. 
There is a generalized Gaussian elimination algorithm which factors the skew-symmetric matrix M as 

M = LD 1/2 JD 1/2 L T , 

where L is lower 2x2 block triangular matrix with the 2x2 block identity on the diagonal, J is given in 
(|1.8[) . and D is a diagonal matrix with multiples of the 2x2 block identity on the diagonal. The rows of 
give the coefficients of the skew-orthogonal polynomials. Numerical computation of skew-orthogonal 
polynomials with V(x) = \x 2 + tx 4 lead to the conjecture that the zeros of the even polynomials are real, 
interlace, and their distribution converges to some measure; and that the zeros of the odd polynomials are 
real, interlace, and their distribution converges to some measure. 

The leading order of the asymptotics of the skew-orthogonal polynomials have been computed by [16) . 
In section [2] we will compute a local (d + 1) x (d + 1) Ricmann-Hilbert problem, where deg(V) — d (similar 
to that of [21]) for the skew-orthogonal polynomials with respect to the skew-inner product (|1.2|) . This 
Riemann-Hilbert problem may be tractable, at least in the sense that the bi-orthogonal one is, and allow 
one to rigorously compute the asymptotic expansion of the skew-orthogonal polynomials. The problem we 
find determines p 2 fc uniquely but only finds P2k+i up to a multiple of p2k- An equivalent Riemann-Hilbert 
problem for the skew-orthogonal polynomials with respect to the skew-inner product (|1.3[) has not been 
found. 
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2. RlEMANN-HlLBERT PROBLEM 

We will now work with the inner product p.2[) however outside of the random matrix context we may 
use the simpler expression 

(2.1) (/, g)i = [[ f(x)g(y)e(x - y) e - v ^- v ^dxdy, 



with no loss of generality. Assume that V is a polynomial of degree d. 
Define 

Wj (x) = / y j e(x-y)e- v ^- v ^dy 



and 

W(x) =e- 2V ^K 

Let 

(/,9>2= f f(x)g(x)W(x)dx. 
Jr 

The skew inner product (|2.1[) is non-degenerate in the sense that the matrix My = (x l ,y : ')i is skew 
diagonalizable; that is it can be written as 

M = LJL T 

where L is lower 2x2 block triangular with non-zero multiples of the 2x2 identity matrix on the diagonal, 
and J is given by (|1.8j) . An equivalent condition is that the principle 2n x 2n minors of M are non-singular. 
The Pfaffian of these principle minors is proportional to a multi-integral of a positive function, hence is 
non-zero. This non-degeneracy gives the existence and uniqueness of the skew-orthogonal polynomials. 

The family of skew-orthogonal polynomials with respect to (|2.ip is characterized by the conditions: 
(P2k(x),y j )i = and <p2fc+i(a0,i^)i = for < j < 2k - 1, p 2k (x) = x 2k + 0(x 2k ~ x ), and p 2k+1 {x) = 
x 2k+1 +0(x 2k - 1 ). 

Define 

n j+d . 1 (y) = ±(ye- v ^)e v ^. 

This function is a polynomial of degree j + d—1 in y. The fundamental theorem of calculus and the definition 
of e(x — y) implies that 

(2-2) (f(x) 1 ir 3+d _ 1 ( y )) 1 =2(f(x),xi} 2 . 

Therefore we find that the 2k orthogonality conditions on p 2 k{x) become: the d — 1 conditions 

(2.3) (P2 k (x),y j )i = 0, 0< j<d-2 
together with the 2k — d + 1 conditions 

(2.4) (P2k(x),x j } 2 =0, 0<j <2k-d. 

For p 2 k+i{x) we find the same conditions (with the same ranges on j). 

Consider a pair of Riemann-Hilbert problems: Find a (d + 1) x (d + 1) matrix valued function Y(z) 
satisfying: 

1. Y is analytic on C/K. 

2. Y has boundary values 

Y±(x) = lim Y(x + ie) 

for x e R 

3. The boundary values of Y satisfy the matrix equation 

(2.5) Y+ = Y-M 
where 

/l W{x) w (x) ... w d -2(x)\ 



M = 



1 ... 

\0 ... 1 / 



4. (a) In the Even problem Y satisfies the asymptotic boundary value 



,2 k- 



(2.6) 



Y(z) = (l + 0(z~ 1 )) 



-2k+d-l 



V 



V 



as \z\ — > oo. 

(b) In the Odd problem F satisfies the asymptotic boundary value 



, z 2k+l 



(2.7) 



Y(z) = (l + 0(z- 1 )) 



z 



as z — > oo. 



Let 



be the Cauchy Transform of f(x) 
We find two theorems: 



C(f)(z) = J- / 



27TZ /ira X Z 



Theorem 2.1 (Even). The Riemann-Hilbert Problem above with asymptotic condition A2.6\) has a unique 
solution given by the (d+1) x (d + 1) matrix 



( P2k C(p 2 fcW) C(p2kW ) ... C(p2kWd-2)\ 



Y 2k (z) 



(0) 

Pm-i 

Plk-1 



\Plk-l 



where P 2 °k-i = a kP2k-2 and Pj*— l' m ^ ^ are P°ly nom ials °f degree at most 2k — 1 which will be specified in 
the proof. The other entries ofY2k(z) are Cauchy transforms of p^_^W , and p^_ x w n , <n < d— 1. 

Theorem 2.2 (Odd). XTie Riemann-Hilbert Problem above with asymptotic condition \2. 7[ ) /ias general 
solution given by the (d+1) x (d + 1) matrix 

( P2k+1 C{p2k+iW) C(p 2 k+lW Q ) ... C(p 2k +lWd-2)\ 



Y 2k+ i{z) 



\l>2k 



J 



where p 2k +i = P2k+i + a k P2k, pf k = bk,aP2k + c k ,aP2k-2, and p^' = b k , m P2k + c^mPaT-r The other entries 
ofY2k+i{z) are Cauchy transforms ofpouW, and p^w n , < n < d — 1. In particular the general solution 
is determined up to a multiple of p2k in each row. 

3. Proof of theorems 12.11 and 12.21 

Uniqueness of the solution in theorem 12.11 follows in the standard way, by checking that both the jump 
condition (|2.5p and the asymptotic condition (|2.6p have determinant one. 

To prove that i^fe is a solution of the Riemann-Hilbert problem with asymptotic condition (|2.6p . one 
checks that: 



• Yii must be an analytic function of degree 2k, hence a polynomial of degree 2k. 

• Y12 satisfies the jump condition 

*i2,+ = Y u W(x) + Y 12 ,- 
across R. The Plemelj formula [1] implies that 

Y 12 (z) = C{Y lx W){z). 
For this function to have the asymptotics 

Yi 2 (» = 0(z- 2fc+d - 2 ) 

the 2k — d + 1 conditions in (|2.4[) must be satisfied. 

• Yi(j+3) (for < j < d — 2) satisfies the jump condition 

y Hj+3),+ = YuWj(x) + Y 1(J+3 ) _ 
across R. The Plemelj formula implies that 

y 10+3) (z) = c(r 11 ^)W- 

For this function to have the asymptotics 

Y iu+3) (z) = 0(z- 2 ) 
the condition (|2.3p must be satisfied. 
Hence Yu(z) is the polynomial P2k(z) satisfying conditions (|2.3[) and 



3.1. Existence of the p^T-i* ^he same arguments as above show that the lower rows of 1^(2) are of the 
form 

(3-1) (&,C(Am, CiAt.wo), C(p^_ lWd ^)) . 

Consider the second row: The asymptotic conditions on Y 2 k{z) imply that f4fc-i satisfies the following 
conditions as \z\ — > oo: 

(3.2) pfl l {z) = 0{z^-% 

oo 

(3-3) Cip^W) = -J+tA-v xj h - ^ 2k+d - 1 + 0(z-^-% 

3=0 

(3.4) C{p { ^_ x w n ) = V -Ij / p^u^x^ = 0(z- 2 ), < n < d - 2. 

2,711 j~a z J®- 

Condition (|3.2|) forces p^fc— l to ^ e a polynomial with degree at most 2k — 1. Condition (|3.3p is equivalent to 

(3-5) (P 2 ° ) -i^ i >2 = i(p 2 l 1 (a ; ),7r J . +d _ 1 (y)) 1 = ) 0<j<2fc-d-l. 

The first 2fc — d — 1 equations in (|3 . 5|) together with the d — 1 conditions (|3 .4[) imply that 

(0) (2k- 1) (2fe-l) 

Pik-l = »2,0 P2fc-1 + < >2k-2- 

The case j = 2k — <i — 1 in (|3.5p implies that 

= (p 2 ° ) _ 1 (x),7r2k-2(y))i 
= 4^ (P2fc-i(a0,7r 2fc _ 2 (2/))i + a^o _1) (p 2i: _ 2 (a;), 7r 2 k-2(j/))i 

(2fc-l)/ / \ 2fe-2\ 

from which we conclude that a^g -1 ^ = 0. Finally one uses the leading order of (|3.3|) to find that 

(2k-l) a ■/ 2fc-l\-l 

The non-degeneracy of the skew-inner product (|2.ip guarantees that (p2k-2,y 2k ^ 1 )i ^ 0. 



Consider the other rows: The asymptotic conditions on Yik{z) imply that Pofe--i> m > satisfies the 
following conditions as \z\ — > oo: 

(3-6) p ( ™ ) _ 1 {z) = 0{z 2k - l l 

(3-7) Cip^W) = -^4^4 = 0(^ 2fe+d - 2 ), 

(3.8) c^^j =_^Lg_i r j^_ lWn{x)x u x = 1^%^ : ; : , < „ < * - 2 . 

Condition (|3.6|) forces p^fc-i ^° ^ e a polynomial with degree at most 2k — 1. Condition (|3.7[) is equivalent to 

(3.9) (Pafc-i'^a = 0, < j < 2fc - d 

The 2/c — d + 1 conditions from (|3.9p and the d — 2 conditions from (|3 . 8|) when m / n determine the 2k — 1 
free variables in t4™-i by solving a homogeneous linear problem. One only need check that 

P2k-\W m {x)dx ^ 0. 

Suppose that this integral is zero, then f>2k = P2k + j4fc-i satisfies the same orthogonality conditions as 
the skew-orthogonal polynomial p2k, which contradicts the uniqueness of p2k- This concludes the proof of 
Theorem O 

In fact we can say more: using (|3.7p we see that we could write the f4fc-i m terms of d— 1 of the orthogonal 
polynomials with respect to W(x) given by 

3.2. The proof of Theorem 12.21 For the odd Riemann-Hilbert problem we note that the asymptotic 
condition (|2.7|) has determinant z. So solutions will only be unique up to possibly d + 1 many degrees of 
freedom. 

The proof that the first row of Y2/C+1 has the form 

(p2k+l(%), C(p 2 fc+l>V), C(p 2 k+lW ), C(p2k+lW d - 2 )) , 

follows as above. The asymptotics of the first row of Y^k fit within those of Y2/C+1 so we only get the first 
row of Y2k+\ up to a multiple of the first row of Y^fc- Therefore we may write p2k+i = P2k+\ + &kPik- 
The lower rows of Y2k+\ have the form 

(p { 2k\C(p^W),C(p^w ), <7(p&W 2 )) ■ 

We will find that the first entry of each row is only determined up to a multiple of p2k , as the orthogonality 
conditions on p2k fit within those of p^k . This gives 1) free parameters in the general solution to the 
Riemann-Hilbert problem. 

Consider the second row: The asymptotic conditions on Y2k+i(z) imply that piS satisfies the following 
conditions as \z\ — ► 00: 

(3.10) p$ = 0(z 2fe ), 

(3.11) C(pg»W) = - .- 2fe+d - 1 + 0(z- 2fe+d - 2 ), 

71-1 j=o z 

1 00 1 r 

(3.12) ^(p^lBn) = -— V -rrr / p^Ws)*^ = O^ 2 ), < n < d - 2. 

Condition (I3.10|) forces p^ to be a polynomial with degree at most 2k. Condition (|3.1ip is equivalent to 

(3.13) (j 3 ^,x j ) 2 = l(p^(x),n j+d - 1 (y)} 1 = Q, 0<j<2k-d-l. 



The first 2k — d — 1 equations in (|3.13[) together with the d — 1 conditions (|3 . 1 2[) imply that 
The case j = 2k — d — 1 in (|3 . 13[) implies that 

= (P2fe( a; )' 7r 2fc-2(y))l 

= b k .o{P2k,ir 2k -2{y))i + dk,o(p2k-i,ir 2k -2(y))i + Ck.o{P2k-2, ^2k-2{v))i 

= 4,o(P2fc-i,y 2fc_2 )i, 

from which we conclude that d k ,o — 0. Finally one uses the leading order of p. lip to choose c k ,o so that 

Cfc,o(P2fc-2,2/ 2fe ~ 1 )l = 

Non-degeneracy of the inner product (|2.ip guarantees that this can be done. The b k ,o remains as a free 
parameter. 

Consider the other rows of Y^k+i' The asymptotic conditions on Y2k+i{z) imply that Pou\ m > satisfy 
the following conditions as \z\ — > oo: 

(3.14) = 0{z-% 

1 00 1 

(3-15) C{p^W) = ~ Ei^',^ = 0(^ 2fe+d - 2 ), 

3=0 

(3.i6) c^ Wn) = -± g - { z -?i z oi-^ : ; > ^ ^ - 2 

Condition (|3. 14|) forces p^ to be a polynomial with degree at most 2k. The conditions (|3. 14113.16]) are 

satisfied by f^-i' which fixes 2k — 1 of the free variables in p^ ■ The orthogonality conditions satisfied by 

P2 k fit within those of p^, hence we find that p^ = b kt mP2k + Ck.mP^-i with Ck, m determined by (|3.16[) 
with n = m, and bk } m a free parameter. This concludes the proof of Theorem 12.21 

4. Conclusion 

Both the bi-orthogonal and skew-orthogonal polynomials naturally split into a pair of families: the bi- 
orthogonal polynomials from their definition, the skew-orthogonal polynomials into the families of even and 
odd degree polynomials. Numerical computations show that in both cases the distribution of zeros of the 
two families appear to converge to separate (yet mutually dependent) measures. 

The bi-orthogonal and skew-orthogonal polynomials are interesting generalizations of the classical theory 
of orthogonal polynomials. They appear in the generalizations of random matrix theory from the well studied 
CUE case. So far little is understood about the necessary asymptotics for both types. We have formulated 
a Riemann-Hilbert problem for the skew-orthogonal polynomials in the GOE case. The structure of this 
Riemann-Hilbert problem is close to that of [H] for the bi-orthogonal polynomials. An obvious problem with 
our formulation is that p 2k +i is not uniquely determined. Experience with skew-orthogonal polynomials and 
the Pfaff lattice hierarchy shows that this is a standard ambiguity complicating the problems. 

The corresponding Riemann-Hilbert problem for the skew-orthogonal polynomials associated to the GSE 
model has not been found. The equivalent to formula (12. 2p does not line up with the Cauchy transform as 
nicely as in the (3 = 1 case. 

Our conclusions are: High order Riemann-Hilbert problems warrant further investigation with the goal 
of finding methods to compute their asymptotics. In all studies of bi-orthogonal polynomials one should 
consider simultaneously the equivalent result for skew-orthogonal polynomials. One suspects that there is a 
connection between these two types of polynomials. 

Acknowledgments: I would like to thank R. Buckingham and K.T.-R. McLaughlin for many useful dis- 
cussions and their comments and corrections. 
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